Good Codes Based on Very Sparse Matrices

نویسنده

  • David J. C. MacKay
چکیده

Unfortunately this paper contains two errors with respect to Gallager's work on low density parity check codes. We gained the impression from the literature that \the sparse parity check codes studied by Gallager are bad," but this is in fact not the case. We also had the impression that Gallager's decoding algorithm was the same as Meier and Staaelbach's, and that our use of belief propagation was a new innovation. However, Gallager in fact proposed and used the identical belief propagation algorithm in 1962. We became aware of these errors shortly before the IMA conference on Cryptography and Coding (December 1995). We established that Gallager's low density parity check codes share all thègoodness' properties of thèMN' codes presented in this paper, and that their empirical performance is superior, as described in our more recent papers.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Good Error-Correcting Codes Based On Very Sparse Matrices - Information Theory, IEEE Transactions on

We study two families of error-correcting codes defined in terms of very sparse matrices. “MN” (MacKay–Neal) codes are recently invented, and “Gallager codes” were first investigated in 1962, but appear to have been largely forgotten, in spite of their excellent properties. The decoding of both codes can be tackled with a practical sum-product algorithm. We prove that these codes are “very good...

متن کامل

Errata for "Good error-correcting codes based on very sparse matrices"

We study two families of error-correcting codes defined in terms of very sparse matrices. “MN” (MacKay–Neal) codes are recently invented, and “Gallager codes” were first investigated in 1962, but appear to have been largely forgotten, in spite of their excellent properties. The decoding of both codes can be tackled with a practical sum-product algorithm. We prove that these codes are “very good...

متن کامل

Good Error{correcting Codes Based on Very Sparse Matrices

We study two families of error-correcting codes deened in terms of very sparse matrices. `MN' (MacKay{Neal) codes are recently invented, and`Gallager codes' were rst investigated in 1962, but appear to have been largely forgotten, in spite of their excellent properties. The decoding of both codes can be tackled with a practical sum{product algorithm. We prove that these codes arèvery good', in ...

متن کامل

Linear Transformations for Randomness Extraction

Information-efficient approaches for extracting randomness from imperfect sources have been extensively studied, but simpler and faster ones are required in the high-speed applications of random number generation. In this paper, we focus on linear constructions, namely, applying linear transformation for randomness extraction. We show that linear transformations based on sparse random matrices ...

متن کامل

Sparse graph codes for compression, sensing, and secrecy

Sparse graph codes were first introduced by Gallager over 40 years ago. Over the last two decades, such codes have been the subject of intense research, and capacityapproaching sparse graph codes with low complexity encoding and decoding algorithms have been designed for many channels. Motivated by the success of sparse graph codes for channel coding, we explore the use of sparse graph codes fo...

متن کامل

Capacity Achieving Linear Codes with Random Binary Sparse Generating Matrices

In this paper, we prove the existence of capacity achieving linear codes with random binary sparse generating matrices. The results on the existence of capacity achieving linear codes in the literature are limited to the random binary codes with equal probability generating matrix elements and sparse parity-check matrices. Moreover, the codes with sparse generating matrices reported in the lite...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1995